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Teaching Decision Malcing to Adolescents: A Critical Review 

ABSTRACT 

In a rapidly changing worid where individuals have great autonomy, citizens must be able to make 
independent decisions effectively. This is especially true for adolescents who face such important 
decisic^s as whether to smoke cigarettes, drink alcohol, stay in school, foltow their parents' advice, and 
hangout with different crowds. To meet this challenge, many programs have recently been devetoped to 
teach decision making to adolescents. In some cases, better decision making is an erxJ in its jlf. m other 
cases, it is a means toward encouraging particular choices (e.g., to avoid sex, to stay in school). 

A sample of the best devetoped of these programs is described and evaluated hpre. with in a 
conceptual f ramewori( derived from formal and behavwral theories of deciswn making. The intemal 
validity of these progr?ms is evaluated in terms of how adequately they cover the normatively prescribed 
steps to good decision making and how sensitive their pedagogy is to the descriptive research into how 
people intuitively make judgments and decisions. Generally speaking, the programs cover the 
prescriptive steps fairly well, while largely ignoring the descriptive research. The external valkiity of the 
programs ir, analyzed in terms of the evaluation studies that have been performed on each. A typical 
evaluation involves asking participants wiietherthey endorse various principles of decision making (e.g., 
-I am the sort of r>erson who lists a lot of alternatives before I make a decision."). Although improvement 
in this sense ioes show that students have listened to the curriculum, it provides no guarantee that they 
are actually beiiaving differently or even have different attitudes - as opposed just to saying what they 
think their teachers want to hear. These auestfonnaires also use a technteal vocabulary that control 
subjects could not know (and use), even if they had the same attitudes. 

Many of these curricula have considerable face validity Their underlying principles seem plausible. 
Their implementation is often imaginative Many of the classes seem as though they teach useful lessons 
and would be fun to take The fact that they iiave gotten as far a^ ihey have shows enormous 
commitment and ingenuity However, making a stronger case for adopting any of these programs 
requires greater atteitic n to both their pedagogical underpinnings and their measurable impacts on 
behavior. 
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INTRODUCTION 

"Problem solving and comprehension; The complete problem solver." "A decision making 
approach to sex education," "Decision skills curriculum." "A cun-iculum for thinking." "Personal decision 
making. * "Decistons and outcomes." "The decision-making book for children." Teaming to think and 
choose." "Power and choice" - ail are currfcula aimed at improving young people's decisfon-making skills. 
Moreover, these are just a small subset of the many programs now on the market. Some teach only 
decision making, while others teach decision making as one of many general thinking skills. Some teach 
decision-nfiaking skills in general, while others teach deciston making in specifc contexts. Their target 
age varies from kindergarten to college, with a few concentrating on adults. 

This proliferation of programs is one response to a widely perceived need to improve higher-order 
thinking skills in general and decision-making skills in partcular, so that adolescent can meet the 
challenges of today's workJ (Resnick, 1987). Here, we take a step back and \ook critically at the products 
of this enterprise. 

Our review begins by defining decision nnaking In terms of normative approaches describing what 
constitutes adequate performance. We then review the reasons that have been advanced for teaching 
deciston making. The following sectton offers a set of criteria for evaluating programs which is then 
applied to several of the better evaluated ones. We end with conclusions and recommendations. 

As mentk)ned, there are many decision-making programs. The best-known ones usually owe their 
recognitk)n to publications in which they are describeo and sonr)etimes evaluated. They typfcally have 
been developed by academics, sensitive to the need for publcation and evaluatfon. Other programs 
have been developed by practittoners, in response to such specific needs as inducing adolescents not to 
smoke or drink. These programs are seldom evaluated in any systematk: way or mentioned In the 
scientific literature. In the course of assembling materials for this review, we quckly realized that there is 
no way to kJentify all potentially relevant programs, much less to secure copies of them. Many 
practitioners are not organized for disseminating materials, some seemed not eager to have outsiders 
examine their hard-earned experience As a result, we decided to concentrate on those programs for 
whfch we had access to curricular materials and evaluation reports We further constrained our focus to 
programs directed at adolescents. Obviously, this strategy may lead to overlooking as-yet-untested 
programs that are superior to those that have b<=*en evaluate j. as well programs directed at other ages 
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that might be usefully adapted to adolescents. 



Decfston Making: Definition and Normativa Modeis 

Decision theorists define decision making as the process of making choices among competing 
courses of actions (Raiffa. 1968; von WinterfeWt & Edwards 1986). For the devetopers of curricula, the 
expressfon "problem solving" often accompanies, or even replaces, "decisfon making" (as can be seen in 
the list of titles opening this article). In the psychologfcal literature, however, the two have sonrwwhat 
different definitions. 

A "problem" is a task whose solution is not immediately perceived. Problem solving is identifying a 
course of actton that ctoses the gap between the present situatfon and a desired future one (Newell & 
Simon. 1972). Tfiat process requires being able to tell whether the gap has been ctosed. that is. whether 
the solution that one currently favors is acceptable. Decisfon makers must also kJentify a solutfon. 
However, they often face conflicting objectives, whose relative importance must be weighed before the 
relative adequacy of different possible solutions can be determined. As a result, one must often compare 
alternative solutfons with regard to how well they maximize one's goals, rather than being able to stop 
once an adequate solutfon has been found. In addftfon. many decisions are made under conditfons of 
uncertainty, so that decisfon makers cannot feel exactly whfch consequences will foltow from their 
chofces. Observers shouW. in principle, be able to tell whether a proposed solutfon meets the constraints 
of a problem. Observers of decisfons face the additfonal challenges of having to discern what goals 
decisfon makers were trying to achieve or what role fortune and misfortune play in what happans to them. 
As a result, the "nonnative" theory of decisfon making is couched in terms of the processes that people 
should follow in order to have the best chance of reaching their goal. The most wWely accepted nonnative 
modeis of optimal decision making were developed by phitosophers and economists and. then, adopted 
by psychotogists for the descriptive study of human decision making (Coombs. Dawes. & Tversky. 1970; 
Edwards. 1954). These nxKlels prescribe the rules that people shouW foltow when making dedsfons. 
given their beliefs and values. 

According to the most general nonnative nxKJel, a person facing a decision shoukJ (a) list relevant 
actfon alt^^matives. (b) identify possible consequences of those actfons. (c) assess the probabi^'^^y of each 
consequence occumng (if each actfon were undertaken), (d) establish the relative importance (value or 
utility) of each conseauence. and (e) integrate these values and probabilities to identify the nrwst attractive 
course of actfon. following a defensible decision mie. People who foltow these steps are said to behave 
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in a ratonal way* People who do so effectively (e.g.. they have accurate probabirtty estimates, they get 
good courses of actton into their list of possibilities) are said to behave optimally . Thus, K one does not 
execute these steps optimally, one can be rational without being very effective at getting what one wants. 

Why Train for Decision Making? 

Cognitive psychologists have studied decision malting for some 30 years, revealing a mixture of 
strengths and weaknesses in people's performance (Abeison & Levi, 1985; Fischhoff. 1988; Fischhoff. 
Svenson & Slovic, 1987; Slovic. Lichtenctein & Fischhoff. 1988). The identification of systematic biases 
has spurred an interest in "debiasing" techniques of the sort that could be incorporated in training 
programs for decisioR-making (Fischhoff. 1982; Kahneman, Sk)vic. & Tversky, 1982; Nisbett. Krantz. 
Jepsen. & Kunda, 1983). 

In nriany ways, the decisk)n-making literature echoes general themes in contemporary psychok)gy. 
One such theme, introduced by White (1959). is the concept of "competence." defined as "an organism's 
capacity to interact effectively wHh its environment." Guilford (1959) talced about "social intelligence." 
believing that socially intelligent people were more "fluent" in thinking about the behavior of others zrti 
more flexible in analyzing human problems. A common view (e.g.. D7urilla & Gokifried. 1971) is that 
interpersonal competence requires active problem-solving and decision-making behavtor. whereby one 
defines a problematk: situation, searches for possible attemative soluttons. selects the best aitemative. 
arKi then verifies its suitability by obsen/ing the consequences of its implementation. This approach relies 
heavily on Bandura's (1977) social learning theory, according to whk:h people who experience social 
diffkxjities are less able to set appropriate goals in social situations and to generate possible ways to 
achieve those goals (Argyle. 1969). The sodal teaming approach hoMs. however, that these 
competencies can be acquired through counseling or training. For example: "Life Skills counseling 
equips adolescents to handle cun'ent problerr^, antk:ipate and prevent future ones and advance their 
mental health, social functioning, economk: welfare and physical well-being." (Schinke & Gik:hrist. 1984, 
p. 13) 

In addition to social learning theory's concern with competent behavior, vanous professions (e.g.. 
clink^l and counseling psychology, social work) have been concerned with the cognitive and so- iat 
processes leading to deviant t>ehavk)r. Such behavtors couki be viewed either as the result of social 
incompetence or as the competent pursuit of socially unacceptable goals. Jessor and Josser's (1977) 
problem behavtor theory provkles a cx)gnitive psychosocial approach to reducing the incidence of socially 
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undesirable behavior. Its advocates attempt to improve personal arKj irrterpersonal functioning through 
training in social and thinking skills in general and in decision making in particular. 

Jahoda (1958) was among the first to emphasize the relationship of effective interpersonal problem 
solving to social and emotional adjustment. In one early study advancing this position, Spivack and 
Shure (1974) found that both more aggressive and more inhibited youths are less competent in solving 
problems and making decisions. Delinquents, appear to be partfcularly deficient in social problem-solving 
skills (Kennedy, 1984; Little & Kendall. 1979), although it is unclear to what extent delinquency is caused 
by the lack of these skills and to what extent it keeps youths from acquiring ti^m. 

In education, the field of instructional psychotogy (Glaser, 1982) promotes cognitive competence, 
usually conceptualized as engineering the transition between leamers' cun-ent skl^' states and that desired 
by educators (Lockhead & Clement, 1979). This emphasis on thinking skills has foojsed research on 
how children think, rather than on what they know. Focal toptes have included (he intviitive understanding 
of physical concepts such as movement (e.g.. McCtoskey, Caramazza & Green, 1980). energy 
(Sotomone, 1983), time (Levine, 1983) and density (Strauss et al., 1983); of statistical a')ncepts. such as 
thie arithmetc average (Strauss et al.,1988) and probability (e.g., Kahneman & Tversky, 1973); of 
biotogical concepts such as natural selectfon (Bojmby, 1984); and of deductive reasoning (e.g., Evans, 
1983). In each case, the goal has been to identify cognitive deficienciec that might be connected through 
instnjction. This concern for intuitive thought processes reflects a belief that educatton rDust conskJer 
where children are coming from, cognitively, as well as where one wants them to be. 

No explicit training is needed, of course, if a skill devetops by itself to its full potential at a 
reasonable pace. Thus, speaking need not be taught to a hearing chiW who has the normal chances to 
practice \h^\ skill. For many years, thinking and deciston making were perceived as skills that dki not 
have to be taught. It was assumed that "omental competence" devetops like language skills through 
biok>gical matuiation, soc'al interactton, and conventional learning. However, vartous evaluattons (a.g., 
National Assessment of Education Progress, 1983) have found that many students fail to devetop basic 
thinking skills. A number of investigators concluded that high school students often coukJ not deal 
effectively with problems requiring abstract thinking (e.g.. Renner & Stafford, 1972) and that as many as 
50% of incoming college students operate below Piagefs level of formal thinking (Gray. 1979). These 
results, too. suggested that thinking skills have to be taught. 
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In addKion to the growth of cognKlve psycholooy, and. with K, the nx)re precise ability to measure 
thinking skills, increased sensKivKy to the changing nature of modem society has also prompted interest 
in teaching thinking skills. In a world full of novel sKuations (Ohen & Novl(, 1984; Eliul, 1963) and 
information overload (Bell, 1978; Canroll. 1971), one cannot teach just facts. By the time students have 
mastered one set of facts, it may be outdated by new developments. Such rapid char^ges require people 
to think for themselves and by themselves, anc educators to provide these general skills (Fletcher a 
Wooddell, 1981 ; Simon, 1980). The comparable change in counselors' roles ha:, been to emphasize 
personal responsibility and maturity in decision maKing (Wrenn, 1962), ^at is, oounsetors shoukJ be 
helping clients loarn how to make better decisions (Gelatt, 1962). 

As expressed by Nickerson et al.(1985, p 4), ''Most of us who live in devetoped countries in the free 
worid have a much greater range of opttons than dki our grandparents, whether we are choosing what to 
have TOr dinner, what to do for entertainment, where to go for a vacatbn. or how to spend a life. It seems 
reasonable to expect this freedom of choce to continue to increase. But optbns imply the burden of 
making decisions and living with them; and the ability to choose wisely assumes the ability to assess the 
alternatives in a reasonable way." Accordingly, Lewis (1983) argues that it is necessary to teach students 
to "analyze informatiop, synthesize it and apply it in a value-oriented way." 

Cassidy and Kuriman (1977) specifcally advocates teachhg deciston making in the social studies 
cun'fculum, claiming that: "Decision making as an educattonal goal derives its justiffcation from two values 
whk:h underlie our American social-politcal system. One of these is belief in popular rule, and the other 
is respect for the indivkJual. From the denrxx:ratk: value of popular rule conries support for devetoping skill 
in making decisk>ns about pubic issues. From the value of indivkJual dignity comes support for making 
souDd decisions about personal problems" (p. 3). 

In addition to the general challenges of living in a modem society, adolescents face partcular 
challenges, placing severe den^nds on the*r decision-making abilities Adolescence is characterized by 
rapid physfcal, cognitive, affective, and social development. As they become more autonomous, 
adolescents must make nrK)re decistons about their lives. In doing so, they must cope with the often 
conflk:ting demands of parents, schools, peers, and jobs (Hartup, 1979; Utech & Moving, 1969). 

One significant category of such decisions are those involving risk-taking behaviors, such as 
srDoking cigarettes, dojg use. school dropout, and sexual activity. The tong-term consequences of the 
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behavioral choices made here, for both irxiividual yo^ihs and society as a whole, are weH krx>wn. Rather 
less is known about the processes leading to them. ^KMigh incurring these risks may reflect ineffective 
decision making, il may also represent a deliberate choice, say, to let the shoit-tenn benefits of 
conforming to peer pressure dominate the !ong*term health risks of smoking. Awareness of t^le 
complexity o; the decisions that youths face has led to statenf)ents like, "...knee jerk prescriptions such as 
just say no, while periiaps appropriate developmentally speaking for the 5-10 year oid...are unlikely to 
fortify developing earty adolescents against unhealthy behavior, nor give him the tools to function 
autononrxxjsly...the just say no approach fails to respect the chik) as an active processor of experience..." 
(Zamansky Shorin et al., 1988. p. 15). (See also Duryea, 1986; Mahoney & Thoreson, 1972.) 

With so many advocates and so many reasons for training in decision making, it is not surprising 
that much effort has been directed at developing such progranris. 

Decision-Making Training: A Classification 

Programs that provide training docision-making can be classified according to: (a) their focus: 
social or cognitive, and (b) their ;^cope: general or specific (where scope is defined somewhat differently 
for the two fool). 

General sodal programs teach skills for solving interpersonal problems, such as coping strategies, 
assertiveness technkjues, and decision-making nwthods. Specific social programs focus on particular 
problems Ike smoking, peer and family relationships, sexuality , physical and psychotogical health, 
vocational and career goals, or societal adaptation. Many ure designed foi' particular populations as well. 
Proponents of these latter approaches argue that general cognitive abilities are necessary, but not 
sufficient for dealing wfth social problems. Rather, adolescents need substantive social knowledge as 
well as the interpersonal skills :)eeded to deal effectively with others, what are often called "life skills." 

In cognitive programs, thinking skills are the focus of interest and not just mediating variables. 
General cognitive programs teach decision making as one of many thinking skills; specific cognitive 
programs teach decision making per se. 

EVALUATION 

Following Ntekerson (1975), we will distinguish between "effectiveness" and "logical soundness," as 
criteria for evauating decision-making {and, hence, the impact of decision-making cunicuJa). A decision- 
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making process Is •effective* to the extent that H produces desired outcomes. That is us'ially determined 
easily after the fact. Decisions are logically sound* to the extent that the decision n^icers* choices are 
consistent both with their values and with the information available to them at the tinne of decision. 

AJthough logical soundness is much more difficult to evaluate than effectiveness, K is also a nx)re 
e5«entia! criteriori. The outcome of a decision is often detennined by factors outside the decision maker's 
control, whereas a togicaiiy sound decision is one that makes the best of a situatfon. Over the tong ojn, 
togically sound decisons ougfl to be more effective. However, that assumption need not hoW in any 
particular instance, so that a sound decision may have an unhappy outoon)e. 

Nonetheless, it appears temptingly simple to evaluate decision makers by how well individual 
decistons worked out. Not only do people h^ive a fascination with such effectiveness (Baron & i^ershey, 
1988). Ixit it seems so easy to evaluate. By contrast, assessing k>3ical soundness requires answering 
such difficult questfons as. What information was available to decision makers at the time of the decision? 
Wh:>. were their preferences? What were their subjective probabilities? How did they combine that 
information to reach a deciston? (Blackshaw & Fischhoff , 1988) Rather than addressing all these 
features, attemots to evaluate k)gical soundness have typically concentrate un just one or two 
comoonents (e.g., how people list alternatives, how they estimate probabilities). 

Whatever criterion is u^ed, it should be assessed through detailed obsen/atton of the processes 
followed in actual decisions. As might be expected from the aifficulty of such research, few such efforts 
have been nxjunted. A more modest (and mote oomi^ion) evaluative criterion is that partfcipants in a 
program learn principles of good decision-making, under the assumption that such conscfous knowledge 
is necessary for better oehavior. An even more rrxxiest criterion is \\\a\ a program at least teach these 
principles. This criterion can be applied to a:ty curriculum, regardless of what data have been collected. 
Decteton theory's normative mies are described in the following sectk>n. 

Of course, presenting merely the principles of good decision making carries no assurance that they 
have been lea ned. A pedagoglcally sound curriculum shoukJ be built on available scientifk: knowledge 
regarding hovK peopPi make decistons and how they can be helped to improve their deciston making. A 
brief summary 'J these descriptive results appears below. 
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Normativs Princlpltts 

A$ mentioned, philosophers and economists have devek)p3d various nomnative modeb of optimal 
decision making (Raiffa. 1968). All these models, whatever their complexity, include some bask: steps 
that any decision maker shouM foltow (e.g.. 9sting attematc^es). as well as some steps that are specifc to 
particuiar circumstances (e.g.. evaluating prot>abilities in uncertain situations). 

Tab!3 1 offers one characterization of the normatively prescribed steps that a deciston maker 
should follow (and that a decision-making cunicukjm shoukJ teach if they do not conDe naturally). These 
are: 

1. Distinguishing t)etween deciston sHuattons calling for different deciston-making models 
(e.g.. decisions under certainty, hsk. and uncertainty) 

2. Identifying and defining a deciscn-making situatton 

3. Listing actton alternatives 

4. identifying criteria for comparing the aKematives and the possible consequences of each 
allemative 

5. Asse&;ing the probability of possible consequences (when r.ocessary) 

6. Assessing the utilities of possbie consequences (when necessary) 

7. Evaluating each alternative in terms of Hs attractiveness and prot>ability 

8. Assessing the value of collecting additk>na! informatbn 

9. Evaluating the decision-making process 

Descriptive Principtes 

Choosir^ what to teach and how to convey it requires an understanding of what students ^now 
already and how they intuitively approach decision-making tasks. Without such understanding, one is 
imposing a foreign perspective, rather than taking students from their current state to a more 
sophistk^ated one. 

The professk>nal literature contains many assertk>ns like "adolescents are risk takers.* 
•adolescents deciston making is alt emotton.* or •adolescents have a limited time perspective.^ However, 
these statements seem to be grounded primarily in anecdotal obsen/atton. As a result, even if they are 
accurate, they provide little insight regarding the details of adolescents* psychotogical processes. In the 
absence of systen^atfc evkJence, the most relevant enr.p:.<;al basis for traintng adolescents may be 
research with adults. This approach is supported by Harmoni et al/s (1 "97) literature review finding no 
derronstrated differences between the dedsion-making processes of older adolescents and adults, and 
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only a few differences between younger adolescents and adults. The !atter include Rowe's (i984) finding 
that 14-year-olds generated fewer potential alternatives than did 18-year-olds when asked to structure 
decision problems, and L6;vis's (1981) findings that 12th graders produced both more possible future 
consequences of their actions and a higher portion of negative items than did 7th graders. Contrasted 
with younger children (grades K to 4). adolescents have fc>een found to have a "reflective tempo" whirh is 
better suited to cognitive tasks than ihe more "impulsive teiDpo" of younger chikJren (Eska & Blar>. 1971 ; 
Kagan, 1965, 1967; Mann 1973; Yando & Kagan. 1970). Othf r investigators have found that greater 
anxiety leads to shorter and less effective decisfon processes (Keinan. 1987; Keinan. Friedland & Ben- 
Porat. 1987; Messer. 1970). The stresses of adolescence might make this threat partfcularly great. 
Ironically, drinking and daigs, comnx)n ways to reduce stress, distort decisfon-making process in their 
own way (Wills. 1985). 

Even though the research base wiih adolescents is limited. nx>st steps in the decisfon-making 
process have been studied some with adults. These studies reveal something about how people 
approach these tasks, how well they do. and what difficufties they face. Systematic oven/iews can be 
found in Abelson & Levi (1985), Fischhoff (1988). Fischhoff. Svenson & Stovic (1987). Slovk:. Lfchtenstein 
& Fischhoff (1988), and von Winterfeklt & Edwards (1986). 

Two examples might suggest the implfoations of such re<^arch for currfoulum development: 

(a) Uncertainty is a base element of many decisions. Research with adults has found a comnwn 
tendency to underestimate the ^ ''^'^ertainty in situations, reflecting, anr)ong other things, faikjre to realize 
riow ccfT^piAx they are (Fischk vc. & Lichtenstein, 1977; Lchtenstein, Fischhoff. & Phillips, 1982). 
If, as is often claimed, children have simpf^flc views about many things, then their thinking, too, should be 
characterized by unwarranted certainty (Sieber, Clark, Smith & Sanders, 1978). As a resuu. uTxeftainty 
ought to be a main cof>cept in currfoula, touching topics like what is uncertainty, what are the different 
kinds of uncertainty, and what is the relationship between uncertainty and amount of information. 

(b) The starting point for any decision is the definition of iis basic components ;the alternatives, 
consequences, sources of uncertainty). Observers have hypothesized that adolescents often behave as 
if they have no choices, meaning that their definitfons of decisfon situatfons have no altematives (or the 
single, simple alternative cf resignation to fate). A related result with adults is the inability to generate 
alternatr»b courses of actton, or to realize how adequate (or impoverished) one's source of altematives is 
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(Rschhoff . Slovic. & Lichtenstein. 1978; Gettys» Mehle & Fisher. 1986; Mehle et al.. 1981). if this is the 
case, tN)n curriojla must teach students to consider multiple alternatives and to specify those alternatives 
clearly erK>ugh that they can be evaluated. To that end, they should be taught generic techniques for 
generating options and generic options such as delaying decisions and seeking help. 

Simitar analyses must be made for each step of the decision-making process, beginning with the 
curricular implications of the existing behavioral literature. In the absence of relevant research, curricula 
can at best be treated as informed guesses at how to teach these skills. A detailed analysis will raise 
additional design questions, such as: 

1. At which age shoukJ various decision-making skills be taught? 

2. What tower-order skills constitute the building bk>cks on whk:h higher-order decisk)n-making 
skills are based? 

3. To wha^ extent are there general decistonniiaking skills, as opposed to skills related to 
specify contexts? Studies of problem solving strongly indcate that expertise reflects 
domain-specifk: schemata (Larkin, 1983; Simon & Chase, 1973). Others, however, believe 
that there are some bask: cognitive skills (Baron. 1985). 

4. How can transfer of training be maximized? According to Sternberg (1983). for example, 
transfer is nrx>re IScely when students experience deciston making rather than just leam 
atx>ut it. According to Brown, Campk)ne & Day (1981), an understanding of what a 
program does, how it does it. and why is also necessary (also Vye et al.. 1988). 

Review of Programs: An Overview 

CXjr review of programs begins with a description of each program's goals and apf>roach. We then 
focus on whatever attempts have been made to evaluate it. Evaluating a cuniculum manipulatton is like 
evaluating any other behavtoral inten/ention. Its impact must be compared to that of no manipulatton at 
all (i.e.. letting education take its natural course) or to that of alternative cunicula. Ideally, such 
comparisons woukJ involve random assignment to treatment groups and appropriate pre- and post- 
treatmeiTt measurement of the dependent variables (Campbell & Stanley, 1963). Even though some 
evaluation has been performed forever/ study discussed here, none approaches these Weai standards. 
As a result, we must evaluate the evaluations, focusing on the nature of each manipulatton and the 
behavioral measures used to assess its impact: 

The curriculum manipulations . Unless a currfculum is cleariy defined and faiirndliy applied, any 
improvement can be attributed to other causes, while any failure can be attributed to the currfculum 
having been improperly implemented. Thus, evaluating a currfculum requires asking questtons like: Was 
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it dear what was training in decision making and what was training for other abilities? Do we really know 
what was done during the training (i.e., how structured was the training? how much control dki the 
experimenter have over how it proceeded?)? 

Anak>gous questtons must be asked about any comparison groups. One must also ask whether 
the non*instnjctk>nal aspects of their treatments were equivaleiit to those of the curriculum group. For 
example, did they receive as much attention and motivattonal encouragenrient? As a resuH. the top half of 
Table 2 characterizes evaluatton studies according to each cuniculum's degree of stoicture, its duratton 
(in hours of instruction in decision making), and the nature of the control groups. We distinguish three 
levels of structure. Counseling programs typically have tow stmcture, while programs with a student 
textbook and a detailed teacher's manual usually are high stmcture. 

The behavioral measures . The ultimate goal of decision- making cunicula is improving decisfon- 
making skills. As a result, changes in those skills provide the appropriate measure of a cunicukim's 
effectiveness. However, for life skills and social skills curricula, decision-making skills are inten^ening 
variables. Their ultimate goal is changing some behavtor, like dgaretto snfx>kjng. 

Whatever variables interest the creators of a curriculum, evaluation is possible only if they can be 
defined operationally. Because of the difficulty of measuring actua' behavtor, nrK>st curricula have focused 
on verbal expresstons, such as expressed attitudes toward smoking or knowledge about the stages of 
sound decision making. Unfortunately, knowing what to say on a knowledge or attitude test need not 
mean accepting those responses as personal belief nor implementing them in one's personal life. 
Several thoughtful reviews exist for the impact of social and life skills programs on behavtors like smoking 
and drinking (Biglan & Ary 1985; Cook, 1985; Glasgow & McCaul, 1985). The present review focuses on 
measures of deciston making. The second half of Table 2 characterizes each evakiotion study in lems of 
^vhat decision-making measures were used and how soon after the training they were administered. We 
had planned to classify the measures ak>ng two dimensk>ns-what they measured (knowledge, attitudes, 
or behavior) and how they measured it (by obsen^ed behavior or verbal reports in questtonnaires) 
However, we found that all nr)easures were verbal reports of either knowledge or attitudes. 

Other issues . In addition to these specif fc measi •^mert issuet^ the studies reviewed here face the 
routine methodok)gical issues any currk:ulum evaluatton. These inck'de how subjects are sampled, how 
they are assigned to condiiions, and how results are analyzed. Partk:ular criticism has been leveled at 
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evaluations that hava used pupils as their unit of analysis when it is actually whole classes that have been 
assigned to treatments (Cook. 1985). There is also constant concern over generalizing results beyond 
the kinds of classes that have been studied. Acknowledging the practical problems facing evaluators, 
reviewers typically call fc identifying common trends among a ?5et of imperfect studies, rather than 
demanding a single perfect study, '^he present review constitutes such a took for overall patterns. 

We begin our review ivith prograrr^ focused on deci?;ion -making skills atone, proceed to the 
decision-makinp pojtiu n of programs dovoted to thinking skills in general, and then consider that aspect of 
social and lifb skills programs. Table 1 characterizes the content oi each program in terms of how rt treats 
nine normative issues (reflecting the steps a good decison maker shouW take). We had planned to 
'od^cate here the attention paid by each curriculum to the descriptive literature re^ariiiig how people 
intuitively perform each step. However, such attention proved so infrequent that there was little to 
indicate. 

PROGRAMS FOCUSED ON DECISION MAKING SKILLS 

Decision-Making Curricula 

GOFEP - A high school course on decision making 

Goal: This course, whch was developed by Mann, Harmoni and Power (1988a. l9S8b). is based 
on Janis and Mann's (1977) conflict theory of decision making under stress. That theory identifies several 
distinctive responses to difficult decision situations, such as vigilance (careful appraisal of options and 
consequences), hypen^igilance (rapki and impulsive choice), defensive avoidance, and complacency (e.g. 
adherence to simple courses of action). It offers a comprehonsive account of the requirements tor good 
decision naking, as well as a coherent explanation for poor decision habrts GOFER embodies this 
theory in a general course in decisksr making intended to reinforce students for applying appropriate 
decision-making skills to a wide range of problems in their lives, including vocational and curriculum 
chotee. 

Level: The course is designed for 15 year-olds whoi.i the authors claim want and are able to learn 
decision-making skills (Hamrwni, Mann & Power, 1987). 
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Duration: GOFER provides a program of readings and exercises designed to be taught over 40-50 
hours during at least a year. 



Course content: GOFER stands for five steps Oi sound decision making - Goals clarification, Option 
generation. Fact find' .y, consideration of Effects. Review and implementation. According to Mann et al. 
(1988a): 

The course materials consist of two books: 'Basic principles of decision making* and "Decision making in 
practice.* The f irsi oook contains three parts: "Wha! is decision making?" deals with t ^9 concept of 
decision making and how decision tasks change according to age. the GOFER strateg/ as a sequence of 
steps to foiiow for making sound decisbns, and the consequences of missing a step on the quality of 
decisions 'Understanding how decisions work' explains the relatk>nship between self esteem atrd decisbn 
making; t concept of a t>atting average' in decisk>n maKfny. poor patterns of decifik>n making (known as 
'Goofers") s'^^h as 'drift on ' loltow the leader.' 'cop out' and 'pank:'; and how to recognize tendencies to 
use 'Goofe ana what to do about them. 'Making decisk>ns work for you' discusses technk^ues to assist 
eac^ step wi s^ound decisbn making. Students learn how to recognize and define decisbn problems; how 
to clarify the goals and values involved in major choces; how to generate optbns; how to check the 
reliability of informatbn; how to assess risks; how to compare optk>ns; and how to 'hatch' dectsbns. 
including announcement, selling the decision. implementatk>n, fine tuning and, If necessary, undoing 
misiikes. In the second book, 'Decision making in practce,' principles of decisk>n making are applied to 
several problem areas of importance to adolescents. There are five parts: Decisbn making in groups. 
Friendships and decision making. Subject choce, Money! Money! and Beyond GOFER, (p.6) 



ThetA/o books are supplemented by student workbooks with exercises and a teacher's manual. 



As indfcaled in Table 1 , GOFER addresses nrwst of the tr\a\n steps of decision making, but does 
not explicitly tr'^at probabilities, utilities, or value of informatk)n. Of all the programs we have reviewed, 
GOFER builds most explicitly on results from descriptive research. This empircal base is drawn from 
Janis & Mann's (1977) research on affective barriers to effective decisfon making. The benaviora! 
decisk>n theory literature on cognitive barriers to sound deciston making apparently ciid not play a role in 
GOFER'S formulation. These barriers tend to affect people's ability to execute partfcular stages in the 
decision-making processes, unlike the affective barriers which affect people's ability to make deliberate 
decisk)nsat all. 



Evaluation GOFER has been evaluated in two studies. The first had 40 experimental subjects and 
51 controls who received no treatment at all. Both were tested only after the course had been taught to 
the experimental subjects. In the second study, the 152 experimental subjects were also pretested, but 
not tha 220 c^njroi subjects, ^notructlorr tesTcu To to 20 hours, so that less than half of theVull course was 
taught. Three questfonnaires were used as dependent variables: 



(a) The Flinders Adolescent Decision Making Questionnaire contains 30 Likert-type items, 
anchored at •'alnrx)st always toje" and "not at all true for me." Six items refer to each of five topics: 
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Decision Self Esteem (e.g., *The dedsions i make turn out well"), Vigilance (e.g., "I lice to think about a 
decision before I make it"). Panic (e.g., "I cani think straight if I have to make a decisk)n in a hurry"). Cop 
Out (e.g., "I doni like to take responsibility for making decisions"), and Complacency (e.g., "When faced 
with a deciston, I go atong with what others suggest*^. 

(b) The Virgil Ojesttonnaire attempts to measure competence in GOFER'S five steps of good 
decision making. For each of twenty pairs of hypothettoal indivkluals, students are asked %vhich kind of 
person are you most like" (e.g., "a person who goes through with plans to get to know some people 
better" or "a person who doesnl go through with plans to get to know some people better"). 

(c) The Dedsion Knowledge Questionnaire contains 24 muitiple-chok:e and 6 open*endcd 
questions related to knowledge about three aspects of deciston-making: person knowledge (e.g., what 
nfiakes someone a really good deciston nuiker?), task knowledge (e.g., what is the difference between a 
simple decision and a thinking decision?), and strategy knowledge (e.g., you want to teach a younger 
student how to make a decision; what advice could you give the younger student?) 

As expected, treatment subjects reported engaging in nfK>re appropriate behavior for all five topk:s 
in the first questionnaire. There were, however, no differences in self descriptions on the second 
questionnaire, which measured competence in GOFER. The third questionnaire revealed differences in a 
"strategy knowledge subscale." but only for the first study. 

In summarizing their results. Mann et al. (in press) claim that the course effectively iniproves 
adolescent decision making in the 12-16 year-okl age range because students report using vigilance as a 
decision strategy. They further daim that the course is acceptable to most students and increases their 
self esteem as decision makers. They admit, however, that the absence of differences in competence on 
the five steps of vigilance is problematic. They blame the measure, since "all other measures suggest that 
the course produced changes.*" (p. 16) 

Evaluating the evabssiicf^: notwa m Taoie 2, one critical limitation to this evaluation is the fact 
that the control group received no treatment at all. As a resuft. improvement in measures like reported 
self-esteem might just reflect the greater attention paid to the treatment group (Battjes & Bell. 1985). A 
second limit is that ail the measures involved questionnaires regarding knowledge of the course material. 
The authors themselves note that reliance on questionnaires leaves open the question of the course's 
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impact on behavior. Thus, the program's apparent success may simply reflect students having learned 
the right answers to the seH*repoit questions. For example. ?i student who has seen 16-20 hours of 
coursework ougl.t to know the "right" choice between, "I like to think about a decision before I make rt" or 
"^en faced with a decision, I go along with what oihers suggest." 

One aspect of the know*iedge conveyed in GOFER (and other cunicula) is the meaning of specific 
tei.ns about decision making. Youths in the control conditton. who had not learned those temr^. might fail 
the test even if they understood the underlying concept. Indeed, the authors report that 50% of the 
control subjects in the first study dki not attempt the task and strategy knowledge items. They conclude 
that *These findings are of interest as they suggest that about one in two control students may have 
lacked the knowledge to attempt the task and strategy items, and they also suggest that the obtained 
group difference might have been greater if more control students had attempted the items." (p. 12) An 
alternative speculation is that the difference between groups might have been much less had more 
accessible phrasing been used in questtons like. "What is the difference between a simple decision and a 
thinking decision?" A course's ability to teach terms is much less interesting than its ability to teach 
concepts or, ultimately, to affect behavior. 

Finally, one might be oncemed by the fact that the course's greatest impact was in increasing 
students' confidence in their decision making (whether this refers to process or outcome is hard to know 
from the report). Although the authors cite this as a sign of success, it might be a sign of failure if 
confkJence was increased without a corresponding increase in competence (especially if people are 
overconfident to begin with) (Lichtenstein & Fischhoff, 1977; Oskamp. 1962). 

Personal Decision Making 

Goal: Personal Deciston Making (Ross. 1981a) conceives of the decision-making process as 
involving five steps: (a) identifying a set of alternative courses of adion. (b>identffyi 
(c) evaluati:)g alternatives by these criteria, (d) summarizing information about alternatives, and (e) self 
evaluation. The program is based on an explicit descriptive theory of how untrained indivkiuals 
approximate the skills used by sophisticated decision makers, kientrfying five developmental stages for 
each of these fiv3 steps (Ross, 1981b}. For example, the five stages for kientifying alternatives were: 
single alternative, a small list of alternatives, brainstorming altematives, constmcting alternatives by 
classification, and constructing alternatives using criteria. The program then offers a sequence of 
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exercises for traversing these stages. 

Level: A condensed version of the program has been prepared for seventh graders and an 
advanced version for eighth graders (Ross, Boutillier, Gutteride» & North, n.d.-a, n.d.-b). 

Duration: The instructional package contained ten lessons, each requiring about one hour of class 

time. 

Course content: Detailed, virtually scripted lesson plans were constnicted containing directions for 
teachers and students. *The first lesson consisted of a pretest and a teacher*directed analysis of a typical 
problem designed to identify the five steps of decision making. Two lessons were devoted to each of the 
first three [steps] and one lesson was given to each of the remaining [steps]. The ninth and tenth lessons 
consisted of a review of the five [steps] and posttest." (Ross, 1981a, p. 238) 

As summarized in Table 1 , this program covered many of the elements of decision making, but did 
not mention probability, utility, or value of infonr^tton. Although sonr^e of the example problems involved 
uncertainty, that topic was not treated directly. The program relies heavily on descriptive studies claiming 
to show that unskilled decision nruri<ing is but a simple version of skilled deciston nudcing (Ross, 1981 (a)). 
Instead of listing all possible attemative courses of action, for example, unskilled individuals list but one or 
two. This theoretk^al orientation is at odds wHh that hokling that unskilled performance is fundamentally 
different from that of experts. 

Evaluation: The cun^iculum was assessed in three studies in whk:h treatment students were 
pretested and posttested on an instrument involving one forced-choice test for each of the five decision- 
making steps. The five possible answers corresponded to Ross's five skill levels. Two sets of items were 
prepared, one for srTX)king decisions, and one for a career chok:e decisis. The first served as a pretest. 
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while the second was a posnest.^ 

The first study involved experimental and control classes in the sanrte school, with the latter 
receiving no treatn^nt at all. The second study had no explicit control group, using instead pretest norms 
established in the same school system one year earlier. The third study involved one teacher wt*' iour 
classes which constituted a Solomon Four-Group Design (Campbell & Stanley, 1963). This design 
crosses whether gioups receive the treatment and whether they receive a pretost (or just a posttest) 
(Solomon, 1949). 

Findings from the three studies were very consistent. The program substantially improved 
students* perfonnance on the skills of identifying altematives, assessing alternatives, and summarizing 
information. More modest improvements occurred for the skill of self-evaluation. The program actually 
appeared to leave students less capable of selecting criteria. 

Evaluating the evaluation: Ross's nr)easures are noteworthy for their sophistication. Nonetheless, 
they. too. test primarily whether subjects have learned the right answers to questions. They, too. reward 
knowledge of specific terms taught in the course.^ A problem nx>re specific to Ross*s measures is forcing 
subjects to choose the connect answers from sets of alternatives 2hat are not nHrtually exclusive.^ Ross 
himself expressed dissatisfaction with these nrieasures and, in a recent paper (Ross, 1988), used open- 
ended items requiring subjects to solve decision problems and describe their strategies. These were then 
coded in terms of the levels for each step. 



^For exampjj, to tost the skill level for identifying aKemativee, subjects were lokl: Sarah is a student in a sdml where t lot of 
students smoke doarettes. She is trying to make up her mind about smoking. Tha first thing do^ (ry nt^^^^^zii 
9il ^ choice about smoking ihar sne couki make. Directtone: Here are some things that Sar&Ji couki do lo find out what choicos 
she couki make. If you were Sarah what would you do? Circle the letter of your answer. 

1 . Sarah shouki make up a list of all the chokies that are possible by asking her friends in school, her aduft friends, and 
her relatives, (level 3, brainstormk.g] 

2 Sarah shouki make up f> iist of all the chokies that she can think of. (ievet 2, smatt list] 

3 Sarah shouki think about this problem very carefully, then she should wnta down what is the best thing to do [level 1 , 
single alternative] 

4. Sarah shouki make up a list of all the chok»s she can think of. She should dMde this list into groups Then Sarah 
fthouki think of n«r.v chok«6 that cooki go in each group. She shouM add these to her list (level 4, classifying] 

5. Sarah shouki make up a iist of all the choices she can think of. Then she should add new choices by thinkkig about 
the things to consktor when making up her mind (level 5, usktg criteria] 

^For example, the level 5 item of the skin 'summarizing the informatk>n* Is: You gave a weight to each consideration that showed 
how important it is. Then you fTHittiplied the value of each choice by the weight of each conskieration. You added up the total points 
k>r each choice. You picked 'never smoke* because it had the highest total score. 

^n the example of footnote 1 , although brainstorming is only an intermediate level. K is not a wrong strategy when done along 
with nr>ord sophisticated onee. 
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General Thinking Skills Curricula 

Intfoducllon 

In their review of apprQa;ches and programs to teach thinking skills, Nickerson, Pf/rldns and Smith 
(1985) divkJed programs into five broad categories: (1) those that focus on t>aslc cognitive skills hek) to be 
essential to intellectual competence (e.g.. Feuerstein et al.*s [1980] Instrnmentai Ennchment Program): 

(2) those that emphasize explk^^ methods, like prcl>lem-solving heuristcs, that f presumably appltoable 
to a variety of cognitive tasks (e.g., Whimbey & Lochhead*s [1979] Problem Solvtuy and Comprehenston); 

(3) those that promote f rmal operattonat thinking w'^hin conventtonal subject matter courses (e.g., 
Schermerhom et al.*s [1982] COMPAS - Consortium for Operating and Managing Programs for the 
Advancement of Skills); (4) those that emphasize symbol manipulatton skills [e.g., Feurzeig et al.*s [1969] 
Logo computer language); (5) thinking about thinking approaches (e.g., Lipman et at.*s [1980] Philosophy 
forChiMren). 

Although there are many prograrns devoted to thinking skills, vf ^ few have a dedston-making 
component. Possibly, decision making is perceived as a higher-order, comotex thinking skill whch can be 
taugM only after the more fundamental, k)wer-order skills have been acquired. Beyth-Marom, Ncvik and 
Sloan (1987) analyzed the normative decisk>n*nuiking process from an instructtonal point of view, 
showing the numerous cognitbe abilities and educational objectives upon whk^h it is based. This might 
explain why the few examples of decisk>n-making units within thinking skills programs are in cumcula 
aimed at college students (e.g.. Hayes. 1981; Wheeler & Oember. 1979). The one program that we found 
foradolescerits is Odyssey -A Currkuilum for Tbinkin^^ 

Odyssey - A Cumculum for Thinking 

Goal: The program was initiated by the Venezuelan government, and created by researchers at 
Harvard University and Boll Beranek and Newnruin, Inc. Odyssey attempts to improve students* 
pertomiance in a wide variety of intellectually demanding tasks. 

Level: The course materials were developed for Venezuelan 7th grade students and have been 
translated into English (Adams. 1986). 

Duratton: There are approximately 100 45-rnirHite lessons, making for 75 hours of direct instmctton. 
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Course oorttent: The course's teacher's manual contairts six series of lessons, each treating a 
different topic: the foundations of reasoning, understanding language, verbal reasoning, prot)lem soMng. 
decision maldng, end inventive thinking. Each lesson has its rationale for inclusion, its ot)jectives, target 
abilities (for students to acquire), products, materials, and classroom procedures. 

The decision-making sectton has three units, each divkled into several lessons, for a total of 10 
lessons: 

Unit 1 : Introduction to Decision Making: Decision Situattons, Anticipating CXitcomes. and 
Alternatives with Unknown Outconr)es. 

Unit 2: Gathering and Evaluating Infomnation to Reduce Uncertainty: Assessing the Licelihood of 
Outcomes, Deckiing Whether Information Is Relevant, Deckling Whether Informatton Is Consistent. 
Deciding Whether Informatton is Credible, and the Importance of Double Checking Infomuitton. 

Unit 3: Analyzing Complex Deciston Situatk>ns: Expressing Preferences ai i Weighting 
Dimenstons. 

This ctirricukjm is very stmctured. with a detailed teacher's manual including guktolines as to what 
the teacher might say and how students might react. There is also a student gukle. The 10 lessons 
devoted to deciston making cover 8 of the 9 topics in Table 1 . They present uncertain situations and the 
concept of probability. They deal with preference' ind how to weight them. Three lessons deal with 
properties of infonnatton: credibility, relevance, consistency. There is. however, little direct reference to 
any descriptive literature regarding intuiuve decision-making processes. 

Evaluation: Three matched pairs of Venezuelan schools participated in the experiment, with four 
classes in each scfx)ol. Twelve of the classes (463 students) were experiments! classes, while 12 (432 
students) were control classes. The experimental classes nrtet four days a week during an entire 
academic year, while the control classes had their nonnal cunlcukjm. Only 56 oi the 100 lessons (5 out 
of the 10 in deciston making) were taught because of time constraints. They were chosen to represent 
the fun set of 100. 

A variety of standard ability tests were administered to all students before the beginning the 
course, after its completion, and. in some cases, at 'various points during the yf ar. In additton. six Target 
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Abilities Tests (TATs) (one for each unit) were created to test for the dbilrlies that the lessons were 
interv^jd to teach. Detailed results appear In the project's Rnal Report (Harvard. 1983) and in Hermstein. 
Nickerson. Sanchez. & Swets (1986). Both experunental students and controls showed some 
iniprovemenl in test scores over the year of the experiment. In most cases, students in the experimental 
group showed greater gains than those in the control group. Not surprisingly, uifferences were nxich 
greater in the TATs than in the general ability tests. Nc specific effects on decision making were 
reported. 

Evaluating the evaluation: Hennstein et al. (1986) sumnrmri/ed their evaluatton by pointing to some 
major unresolved issues: (1) Only short-temi results are avaV'^kie at present. It is unclear whether the 
effects will fade without additional training. (2) It is diffkxitt to know whether benefk:ial effects were due to 
specif k: aspects of the course or simply to the nr)otivatk>nal effects of receiving such great attentbn. To 
these concerns, we wouU add the possibility that the TAT tests (whk:h showed the greatest impact) 
nr<easure primarily the acquisitton of specific terms and facts. These tests are partk^ularty vulnerable to 
charges of training to the criterion because the exploit objectives of many study uni^> were to enrtance 
the comprehenston anc* use of tenns used in the test questions. 

PROGRAMS TEACHING SOCIAL AND LIFE SKILLS 

Both social skills and life skills programs are based on the same theoretfeal orientaik>ns: Bandura's 
(1977) sor'^l learning theory and Jessor & Jessor's problem behavfor theory (1970). According to these 
approaches, personal and social comprtence depend on two main factors: people's general cognitive 
skills and their ability to interact effectively with their social environment. 

•Life skills counseling equips adolescents to handle current problems, anticipate and prevent future 
ones and advance their mental health, social functioning, economfc welfare and physfcal well being* 
(Schinke & Gitehrist. 1984, p. 13). Typfcally. courses attempt to achieve these very broad goals through 
improving certain (behavforal) skills renting to a specific problem in a predetennined target group. 
Hence, there are We skills programs designed to prevent smoking, drug abuse, ateohol abuse, and earty 
pregnancy, as well as to improve adolescents' peer and family relationships, to help them cope with 
stress, etc. By contrast, social skills programs attempt to improve social behavfor in general. In practk», 
though, every life ^\\\s program has some sodai component. Nonetheless, we will foltow the distincJfon 
made by curriculum devek>pers. We look only at those cumcula that address decisfon making explicitly. 
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There is, of course, the theoretical possibility that improved decision makir)g will be a byproduct of training 
for other skills. 

Life Skills Programs 

Schir ^ . et al/s Life Skills Counseling 

Goal: According to Schinke and Gilchrist (1984), personal and social competence can be acquired 
through life skills counseling. This counseling involves six components: (a) giving accurate and relevant 
infooDation . (b) buikJing internal control by " scif-instajctfon counseling through modeling and rehearsal.' 
(c) teachino adaptive copying techniques, (d) shaping effective communication schen^s. (e) encouraging 
the buikJing of "Cognitive interpersonal and environmental systems of support ." and (/) irrproving the 
process of decisfcn making. These interventicr^ are called "counseling" rather than programs, reflecting 
a flexible, less stAJCtured process. Ho stmctured curricula have been published. 

Level: Schinke and his colleagues have worked with a wide range of ages, inckjding elementary 
school chikJren preparing for junior high school, sixth graders concerned about smoking, and high school 
"Students dealing with their sexuality and the risk of pregnancy. 

Duratton: The substance abuse prevention programs consist of 8 twfce-weekly sesstons. The 
program preparing students for junior high school lasted for 8 hours over two months, as did an 
Intervention for stress management (Schinke. Schilling & Snow. 1987). The decisfon-making conponent 
of these programs takes only an hour or two of the tot?l time. 

Course content: Generally. Schinke and his collaborators* counseling is directed at specific 
problems such as interpersonal relationships (e.g.. Schinke & Rose. 1976). preventing teenage 
pregnancy (Schinke. 1982), preventing the use of akx)hol. cigarettes, and drjgs. and reducing 
unemployment (e.g., Schinke & BIythe, 1981), or preparing students for junior high school (Snow et al., 
1986). 

Problem solving is the component of these programs that is the most relevant to dedston making. 
Schinke s general instructfons to counselors usually describe the foltowing steps to good dedsfon making: 
define the problem, generate solutions, evaluate the solution, select the best one, and plan to implement 
it. Examples from students' personal experience are used to teach these various steps. Student are 
encouraged to pose questions like: What's the problem? Who's got the problem? What happens If the 
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problem goes on? How did yoo get into this mess? Who wan get you out of It? WJ.dt can you do to solve 
the problem? Can you order your options f<om the most to the least atlractive solutions? Can you ten what 
will haopen If you use each solution? Students are also taught assertive communication skills through 
role playing designed to provide tl .em with practice in sticking to tough declstons. dealing with risky 
situations (and influential people^ and exercising seH-control. A comWnatton of nwdellng. feedback, 
reinforcement, and coac::.jg are utilized to teach these skills. Homework assignments provkJe addtfonal 
practice. 

Evaluatton: Many of these Ufe skills intenirenttons have undergone sonte evaluation. typk:ally 
irtvolving pretejt and posttest evaluations with ax^.^erlmental and control groups. Botvin and Wills (1985) 
and Botvin (in press) have reviewed the impact M these programs on substance abuse: Snow. Gilchrist, 
and Schlnke (1985) have done so for smoking preventfon. These evaluations have often shown 
significant changes in these focal behavtors. Schinke and Gitehrist (1983) repoted. for example. 1 79% 
reduction in experirr.3ntal snwking. The occaslona* attempts to measure social and cognitive mediating 
processes have produced less clear-cut results. 

Evakjating the »,vakjatlons: A general problem in evakjating (x«.nseling interventions is 
operattonalizing the independent variab'-. As life skills training is not structured. R is vory diffkajit to know 
exactiy what is done and. hence, what aspects of a program cause any obsen/t ' changes in behavfor. in 
only one case (Schinke & Gite-^rist. 1986). has an attempt been niade to vary the featu j of programs 
across experimental groups. 

Schinke and his colleagues have been concerned about the valklity of their behavioral measures. 
Earfy studies often used self-reports as their dependent measures, mnning the risk that subjects will 
report what they believe to be desired answt r. rather than their actual attitudes or behavtor. i tore recent 
studies have collected saliva or breath samples prior to collecting self-report data. 

Unfortunately, these evaluattons have produced little raliaWe informatton regarding cognitive ana 
social variables (such as assertiveness. k>cus of control, social anxiety, declston making, ano problem 
solving), hypothesized to have mediated these changes. Some evaiuatton studies ignore these mediating 
cognitive skills (e.g.. Snow. Gilchrist. Schilling, Schinke & Kelso. 1986; Schinke & Gitehrist. 1986). Others 
mentfon that general problem-solving ability was measured, but provide few detail how this was done 
beyond general references to skills such as perspective taking, means-end thinking, and anticipatfon of 
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consequences (e.g.. Schinke & Gilchrist. 1985: Schinke, Gik^hrist. Snow. & Schilling. 1985). Schinke and 
Gilchrist (1984) describe two of these nf>easures. With legard to nrteans-end thinking. *oounsek>r8 supply 
adolescents with the beginning and the end of a social situatton and youths niust detail what happens in 
the mMdle. Youths* responses are scored for realism, interpersonal sensitivity, recognitton of possble 
obstacles and for how well and how directly they are able to link the beginning to the end." (p.30) With 
regard to antcipating consequences. 'A written or veibal prompt from the oounsetor outlines a situatton 
containing a temptatton. Adolescents are asked to list everything that might be going through their minds 
while they decide what to do. what they choose to do. and what happens* (p. 30) The reliability of the 
scoring for these tasks and their relevance to specific decisk>n-making skills is undear. 

Botvin's Life Skills Training - A Self-Improvement Appfoacfi to Substance Abuse Preventfon 

Goal: To prevent tobacco, alcohol, and drug atxjse through the devetopment of general coping 
skills, as well as skills and knowledge specifically related to resisting social infkiences. A central feature 
of the program is teaching cognitive skills for enhancing self-esteem (e.g.. goal setting), resisting 
persuasive appeals (e.g.. formulating counterarguments), coping with anxiety (e.g.. relaxation 
technkiues). and improving communication and deciston making. 

Level: The program is aimed at middle or junior high school students. 

Duratton: The full course takes about 15 hours. 

Course content: Conpared to Schinke*s counseling program, this training program has the 
markings of a cumculum. There is a stoictured student guide, as well as a detailed teacher's manual. 
The curriculum is taught using a combination of instructton. modeling, rehearsal, feedback and 
reinforcement, and practice through homewortc assignnnents. 

The curriciiium contains 5 major components (Botvin. 1983): 

1. A cognitive component intended to present informatton concerning the short- and k>ng-term 
consequences of substance use. prevalence rates and social acceptability, and the process 
of becoming dependent on tobacco. akx>hol. or marijuana. 

2. A decisk)n-making component intended to foster the devek)pment of critical thinking and 
responsible deciston making. 

3. A component intended to provide students with techniques for coping with anxiety. 

4. A social skills training component, including both general coping skills and assertiveness 
techniques which can be used to resist direct peer pressure to smoke, drink, and use drugs. 
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5. A self-improvement project designed to provide students with techniques for changing 
specific personal skills or behaviors. 

Each component contains two to six lessons. Each lesson is divided into i2 units, containing a 
major goal, measurable student objectives, content, and classroom activities. 

The decision-making unit (two lessons) is called "Dedston making and independent thinking." The 
goal of the unit is that "Students will gain understanding of how group pressures and persuasive tactk:s 
influence their decisk>ns." Its objectives are: (1) kJentify everyday decistons; (2) describe how important 
decistons are made; (3) present a 5-step nonnative model for making dedstons; (4) denrx)nstrate how 
decistons are influenced by group pressures; (5) discuss reasons why people are influenced by group 
members; (6) kJentify persuasive tactics (flattery, appeal to authority); (7) kJentify ways of resisting 
persuasive tactics (Botvin, 1983). Thus, five of Table Vs nine decision-making skills are taught. 
Descriptive behavioral research is reflected in only one social aspect of the program, how group pressure 
affects decisk>n making. 

Evaluation: Rv ^jdies are reported ir the literature and several wore are underway (Botvin, Eng 
& Williams, 1980; Botvin & Eng, 1980; Botvin & Eng, 1982; Botvin. Renfck & Baker, 1983; Botvin, Baker. 
Renick, Filazzola & Botvin, 1984; Botvin et al.. 1984). Each involves an experimental and a control group, 
receiving pre- and posttests. The test questionnaire asks for self-reported smoking status, knowledge 
about cigarette smoking, assertiveness, psychosocial knowledge, kx^us of control, coping strategies, self- 
esteem, social anxiety, attitudes toward smoking, personal effk:acy. interpersonal control, academic 
confMence, decisk>n-making autonomy, problem-solving confkjence and need for group acceptance. It 
has been administered in studies varying implementation schedule (5 to 15 weeks, with or without 
"boosters"), implementers (staff members, peer leaders, regular teachers), and length of follow up (from 
one to 24 months). All studies show a decrease in the number of new snrwkers in the experimental group 
and a decrease in regular smokers when subjects are tested again after a year or two. Furthemx)re, 
experimental subjects were found to have greater knowledge about substances, psychosocial processes, 
and advertising. They also reported greater decision-making autonomy. 

Evaluating the evaluations: Botvin is quite self*critical about his evaluatk>ns, even incorporating a 
manipulation check to see whether the implementation was proper. Recognizing the weakness of self- 
report measures of the dependent variable (smoking or other substance use), he added a saliva sample 
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in later studies. 

Botvin and his collaborators measure social and cognitive noediating variables with 112 forced- 
choice questions, mosWy of the Likert type. Seven relate to decision making (e.g., "I think about the 
different choices that exist before I take any actton," "I think about whk:h of the alternatives is best"), while 
eight relate to confidence in solving problenris (e.g., "Many of the problems that I face are too hard to 
solve," "I have the ability to solve most problems even though at first it kx>ks as if there's no solution"). As 
elsewhere, cne must ask whethe** these questions encompass the full set of skills which the program 
attempts to .w'lch and whether the behavtor reported in them is actually adopted or is just a ieamed "right 
answer." 

Spitzhoff et al.'s Decision Skills Curriculum 

Goal: This program (Spitzhoff, Stephen & Wills, 1982) is based on a theoretk:al orientatton. 
supported by empirical evklence, which views addictive behavtor as a stress-reducing factor (Shippman & 
Wills, 1985). However, as such, addictive behavtor is a destaictive copying pattern. Wills (1985) stiowed 
that construct ye coping patterns (such as decisk>n making and cognitive coping) are negatively 
correlated with substance use. They presumably act to increase resistance to intemal and external 
pressures to use such distinctive behavbr. The program was designed to affect mediating coping 
variables presumed relevant to deterring smoking initicitton, specifically, deciston-making ability, intemal 
k>cus of control, knowledge about the negative consequences of smoking, and assertiveness skills. 

Level: The cumculum is taught to seventh graders. 

Duration: The full program takes two weeks. 

Course content: The program has an intermediate level of stnjcture. It contains eight nxxJules 
including teachers* worksheets, slkJes. rolei)laying exercises, and video cassettes which teachers are 
apparently free to use in different ways. There is no student textbook. 

IIS eight modules are: 

1. A values clarificatton exercise which focuses on leisure activities. 

2. Decision making: Students are encouraged to bring up many decisions and are introduced 
to 6 nomnative steps of decision making. 

3. Social influences through the media: Students consider the effects of the media on their 
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health behavior, partinulariy on the onset of smoking. 

4. Social influences through peer pressure and how to counteract those influences. 

5. Assertiveness training. 

6. Stress mariagement: a four-step process to deal with stress. 

7. Stress management: how to incorporate stress nrianagement techniques into one's We style, 
focusing on progressive muscle relaxation. 

8. Health consequences of snf)oking. 

The decision-making module includes two lessons. They introduce the topte. provkle examples, 
describe six steps of normative deciston making, and present practfce on hypothettoal situations. 

EvaJ'jalon: An interventton program was conducted with the entire seventh grade in three juntor 
high schools which initially showed similar levels of reported snrwking. The two schools in the 
experimental condition received the full smoking prevention program that year and a foltowup program the 
next year. Evaluatton data were obtained with a simple questionnaire whfeh v;as administered in school 
classrooms by project staff at the beginning and end of each school year. The items were divided into 
eleven factors (by previous factors analyses): deciston making. aduH social support, cognitive coping, 
peer social support, substance use, phystoal exercise, aggresston. social entertainnrient. indivkJual 
relaxatton. parental support, and prayer. The deciston-making port ton of the quest tonnaire coritair»cd nine 
items beginning. "When I have a problem. I...," and ai »ding with one of nine complettons: think about 
whfeh informatton is necessary, think about chofces before taking any action, get informatton needed to 
deal with the problem, think about whfeh attemative is best, think about risks in different ways, think about 
possible consequences of aftematives. compromise to get something positive from a situation, change an 
attitude that contributes to the problem, change behavtor that contributes to the problem. The 5-point 
response scale was anchored at "never" and "usually." 

In one of the ftvo experimental schools, the program increased deciston-making skills and internal 
health tocus of control, while decreasing stress and smcking initiatton. In the other experimental school, 
however, there was no effect on any variables, dependent or mediating. Wife (1985) describes some 
aspects of the latter school's atmosphere that may have blunted the treatment. 

Evaluating the evaluatton: The control group received no treatment at all. while the treatnrient 
program was relatively stmctured. raising the risk of attentional effects. There is also the risk of training to 
the criterion in the setf-reports of deciston making. The study was unique in testing tong-term impacts on 
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the mediati;>3 vanabies. 

Social Skills Programs 

Pellegrini and Urfoain (1985) have evaluated 19 training programs aimed at improving 
"interpersonal problem*solving skills^ perhaps the most systematic and comprehensive of which have 
been developed by Myma Shure, George Spivack, and their colleagues at the Hahnemann Medical 
College in Philadelphia (e.g., Shure & Spivack, 1971 ; Spivack & Shure, 1974). Details on the content, 
duration* and level of these progran^ can be found in Pelleg.ini and Urt)ain*s review, which also provkles 
an instoictive sunvnary of potential methodok>gical problems. 

Shure and Spivack concentratec^* on devetoping and integrating three skills: (1) alternative thinking: 
the ability to generate nxiuiple soluttons to interpersonal problems; (2) consequential thinking: the ability 
to foresee both short-term and long-range consequences of different alternatives; (3) means*ends 
thinking: the ability to devetop a plan of specific acttons to attain one*s goals, anticipating and overcoming 
potential obstacles. The program uses a sequential series of scripted games and group exercises. 

Although they are potentially relevaru to irr^oving the declston-making skills of adolescents in 
general the sodal skills programs covered by Pellegrini & Urt>ain*s review were all directed either at 
pre-adolescent children or at special populations, such as delinquent or aggressive/impulsive youths 
(Zahavi & Asher, 1978). In addition, there was no specific measurement of decisk>n*nr)aking abilities. 
Therefore, we will not summarize this review. 

SUMMARY & CONCLUSIONS 

Content 

As shown in Table 1 . most of the programs reviewed here provkie training in 4 to 6 elenients of the 
normative process of decisiop making. The Odyssey program is excepttonally ajmprehensive. It atone 
teaches how to distinguish among diffeient deciston situations and conveys kJeas about probability and 
utility. However, there is more to decision nuking than even these steps. 

Most of the cumcula that we have reviewed are equally incomplete in their treatment c the 
research literature regarding decisk)n*making processes. Although GOFER and Personal Decisk>n 
Making are significant excepttons, each has a fairly narrow perspective. GOFER buikls on research 
regarding the obstacles that stress poses to cognitive functtoning in general and to deciston making in 
particular. The importance of those factors is suggested by Zakay and Wooler's (1984) finding that the 
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improvement generated by a training program for adults disappeared when decisions had to be made 
under tinw pressure (which reduced the performance of trained and untrained subjects to the same low 
level). By contrast. Personal Decision Making is based on research that claims to show that intuKive 
decision-making processes are only a simplified version of the nomratively correct ones. Neither of these 
programs considers the research central to the other. Neither they nor any of the other thinking and 
decision-making curricula are sensitive to the research on peer pressures and socialization whteh is 
central to the life and social skills program. Finally, none of these programs demonstrate more than a 
passing familiarity wKh the cognKive IKerature of behavtoral decision theory. Studi«is there provide some 
insight into how people intuKively perform each componeiit of the decision-making process, where they 
need the n»st help, and what interventions are most effective (e.g.. Fischhoff. 1982). 

Educational programs ought to reflect all that we know about how people behave. Thus, the 
content of decision-making programs must be faulted unless K eKher incorporates this IKerature or 
demonstrates Ks irrelevance (just as behavioral decision-making researchers might be faulted for not 
having translated their results wKh adults into programs for adolescents). A legKimate claim can be made 
that no program has enough time to teach everything. However, that is no excuse for not nriaking what is 
taught sensKive to research regarding those topics. 

Evaluation Studies 

An evaluation is meaningless unless one knows just what has been done. Unfortunately, defining 
the manipulation or treatment is a recurring problem wKh most of the life and social skills programs, much 
more so than wKh th« more structured thinking skills and decisfon-making programs. Where the exact 
procedures can be discerned, they often appear to be somewhat at odds with the programs' proclaimed 
goals of improving decision-making and problem-solving skills. Namely, 'many programs in this area 
teach students liow to behave as opposed to how to think. That is. altemative ways of responding to 
interpersonal problem situations are often nwdeled by the teachers or therapists and then children are 
often coached and given social reinforcement for their behavior. The problem this creates is that K 
becomes difficult to separate out the effects of the cogniiivc aspects of the 'rainir.g from the effects of role 
modeling, coaching and social reinforcement." (AdsK, 1988. p. 28) 

The brevHy of most programs (line 2, Table 2) must raise some doubts about the possibilities for 
changing anything so fundamental as general decision-making skills. !t woukJ be hard to expect such 
changes from students who bring with them no bad habrts, much less from students who already have 
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inappropriate intuitions which nujst be unlearned. The relatively short duration of these kitervemions 
could be contrasted with the much greater class time invested in teaching a skill like additton, where it is 
much easier to give clear-cut feedback. The last row of Table 2 shows the absence of tong-term follow- 
up studies. Conskiering the nxKJest size of the present interventtons. we suspect, regretably, that such 
studies would show little effect on deciston-making abilities. We woukJ be similarly reserved about the 
prospects for showing generalir.ation beyond the context within whk:h tests were made (Glasgow & 
McCaul. 1985). 

!n almost all cases, training programs were compared to control groups receiving no treatment at 
all. Where present, control groups typically received no attention at all (or even negative attentton, if they 
knew that other classes in their school were receiving special treatnr^ent). An attentton manipuiatton is 
particularly important conskiering the exhortatton to work hard whch is part of nK>st curricula (e.g., list 
many altematives, think about many criteria). That pressure might by itseK ^r^'" ;e improvement on test 
tasks, regardless of the other features of a ctin^kxilum. This may be partkxjiarty true when, as was 
typically the case, the test was no nrx>re than a setf-report. It is relatively straightforward to tell teachers 
what they want to hear about one's behavior. Leaning right answers may be a necessary condition for 
better decision making. However, it is cleariy not sufficient. All too often, whatever support can be found 
for a curriculum may reflect no nx>re than training to the critenon. Moreover, even that learning may be 
somewhat illusory where a signif k:ant part of the training involves teaching a special vocabulary-so that 
test questions may only be meaningful to course takers. Thus, control group subjects might behave 
similarty but simply not recognize the temis in which behavtor is described. Sonf)e of those problenv can 
be avokJed. Where the critfcai kind of behavtor is a \om of overt "risk taking," like snrwking, then it may 
be possible to take supplementary measures like urine or saliva samples. Where deciston-making 
processes are the dependent variable, direct observatton is much more diffk^utt. A final source of concern 
is that despite teaching relatively similar steps of decision making (Table 1), every program studied uses 
its own set of dependent measures (Table 2, middle section), with no cross-referencing or psychonietric 
studies. Thus, this critical aspect of evaluation is quite undeveloped. 

One partk)ul&riy suspect measure used in several evaluatbn studies was confidence in personal 
decisfon-making capabilities. For example, GOFER students responded to statements like "the decisions 
I make turn out well." Botvin's students responded to "I have the ability to solve most probi ^ms e^ en 
though at first it looks as if there is no solution." ImprovemeiTts in this sort of confkience might even be 
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undesirable if it represented an increase in confidence (and in overconfidence) without a corresponding 
increase in competence. In this respect, the GOFER question would be especial^ troubling. Botvin's 
question asks more about perceived abilHy to do something constructive (instead of panic, delay a 
decision, etc.). whereas the GOFER statement represents faith that things will woi1( out. 

DespHe this inconclusive evidence regarding changes in decision-mal<ir>g behavior, some programs 
do seem to have denwnstrably reduced risky behavtois. like smoking and dnig abuse. There is. 
however, simply no way of knowing why they work and what is the specify contribution of their declston- 
makirig component. Conceivabiy. they do not teach deciston-making at all. Rather, the deciston -making 
component just serves to give students a feeling that they are being trusted to make their own chotees. 
That. In turn, makes it easier for them to accept the strong persuasive messages in the rest of the 
program materials, telling them what to deckle about sex. dmgs. smoking, etc.. under the guise of telling 
them hojjv to go about decWiiig. 

Oeciston Making about Decision-Making Curricula 

Reviewing the experience wHh existing curricula raises several general questtons regarding future 
programs and their evaluattons: 

What are the aims of the prciram? 

"Improving decision-making skills" is too general a goal for designing or evaluating a curriculum. 
We have already mentioned the difference between knowledge about decisfon-making princess, 
attitudes toward decision-making procedures, and actual decisfon-iT«king behavior. To the extent that 
appropriate knowledge and attitudes are necessary condHfons for behavtor change, they shoukJ also be 
goals of training. However, learning the right answers to knowledge questions providers no guarantee of 
wanting or being able to implement them in practice. Thus, behavior change shouW al:» bo measured - 
recognizing the difffculties of doing so. 

What t heoretical approach g uidas a cufficulum? 

As Sternberg (1983) notes, any training program shouW be based on a theory of intellectual 
perfonnance. We have argued th. ihe theoretical bases for decision-making curricula shoukJ be a 
nomiative theory of how dedsions shouW be made and a descriptive theory of how they are made. That 
descriptive account should Include not only intellectual aspects of decision making, but also its emotional. 
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motivational, and sodat aspects. There is an extensive literature regarding these aspects, at least for 
adult behavior, txit it is as yet neglected. It should be supplemented by the more general literature of 
instnjctional psychology which emphasizes lessons Kke the importance of explicating the appropriate 
probiem-soMng structure, procedures, and strategies, and of ailowtng problems to arise naturally, in order 
to address them and replace them with new behaviors. 

The normative content of decision-making curricula also requires further thought. The model 
imptictt to most existing programs is that the expert decision maker is an industrious person, going over all 
deciston-making stages, quantifying every step, and integrating it effectively, unaffected by any bias. 
There is little discusston of the possibility that good decision making may also involve knowing how to 
make effk^ient short cuts, or having "canned** decisions available for some situattons. If "an important 
aspect of intelligence is deciding just how one's resources and especially attentk)nal resources shoukl be 
^Ik^cated" (Stemberg, 1986). then that also ought to be an important aspect of good declston nriaking. An 
expert deciston maker might know, for example, when the transactton costs and expected yieki of a 
fullblown decibion-making process are not worth the effort. Deciston-making expertise might ntean 
having a set of general decision schemata and being able to match them to specifk: deciston situattons. 

How shoukl we evaluate a decisfon-making program? 

A comprehensive answer to this questton (like the others) requires an article of its own. Clearly, a 
set of evaluative criteria ought to be in place before a program is undertaken. These shoukl include 
criteria of internal validity such as the fWelity ot ihe program to the normative and descriptive literatures on 
decisfon making. They shouW inckide criteria of external valkJify such as changes in behavfor. 
emphasizing generalizability and durability. 

Should decisfon making be taught in a specific domain or in its own rioht? 

CXjr review covered two kinds of programs: life and social skills programs, whteh taught decisk)n 
making for the purpose of infkjencing specfte behavfors (e.g.. smoking, drinking), and decisk)n-making 
programs, aimed at improving decisfon making per se. This contrast in approaches is a special case of 
the general issue regarding the generality and speciffoity of intellectual processes. This conflfct has tong 
been a controversial topfo in the educatfonal and psychofogfoal literature. 

Those who advocate the specif fc approach (e.g.. Glaser. 1984) claim that one cannot separate 
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knowtedge from processes: "High aptitude individuals appear to be skillful reasot^dis l>ecause of the level 
of their content knowledge as well as t>6cause of their knowledge of the procedural constra *<= of a 
parikjular problem fonn... Thus, improvement in the skills of learning... takes ptace through the exercise 
of conceptual and procedural knowledge in the context of specific knowledge domains. Learning and 
reasoning skills devetop not as abstract mechanisms of heuristfc search and memory processing. Rather, 
they devetop as the content and concepts of a knowledge domain are attained in learning situations that 
constrain this knowledge to serve certain purposes and goals." (p. 99) From this perspective, it seems 
best to teach such skills as problem solvir*: and deciston making in terms of familiar knowledge domains. 
Summarizing the literature Glaser and Bassok (in press) concede. "Useful knowledge is not acquired as 
a set of general propositic but by active applk^tton during problem solving in the context of specific 
goals.;* (p. 42) 

According to the general approach (Sternberg, 1985), "processes of various degrees of domain 
generality are critical to the acquisitton and utilizatton of domain-specHfc knowledge, just as domain- 
specific knowledge is critical to the acquisitton and utilizatton of further domain specific knowledge." (p. 
572) Those who hoW this belief recognize the value of usjng familiar materials in teaching, but view it as a 
vehtele for conveying general skills. They argue, however, that it is more efffcient overall to seek such 
general understanding, rather than having to address deciston making in every domain separately. 

Hov; can we get good transfer? 

The relative efficiency of general and specific approaches is one aspect of the transferability of 
training. "Transfer is change in the perfonnance of one task as a result of the prior perfomiance of a 
differeni task (Gick & Holyoak, 1987). Typically, the amount of Innsfer depends on the degree of 
similarity between the two tasks. Thus, more transfer woukJ be expected to decision problems in IHe that 
are similar to those conskJered in the training period. Although the principle of similarity is well 
established, the definition of sinilarity must bt> detennined for particular tasks. The role-playing exercises 
in many cunicula seem to represent attempts to capture as much as possible of the setting in whfch 
actual decistons vill be made, including their emotional and social pressures. Although this appears to be 
a reasonable strategy, a more comprehensive account is needed. For example, if we successfully teach 
6 '. j^tc steps of decision making for every deciston. then that is probably what will happen in real-life 
situattons that cue lessons from tfie course. However, real-IHe situations often involve time pressure, 
making such thoroughness a luxury. Thus, even H there are strong commonalities to decision making in 
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different contexts, a program might still have to provide the special decision-makir)g skille rteeded for 
specifif situations. 

Several other principles o^ training are worth remembering: (a) More train.^ improves transfer; two 
to eight hours of decision-making training is obviously not enough (or such a complex skMI. (b) Transfer is 
best with varied training problems, (c) Transfer is best if an at)stract rule or explanation accompanies the 
specific solutions (Gick & Holyoak, 1983; Glaser & Bassok. in press). 

When shall we teach what? 

No doubt, adolescence raises serious decistons. Although that raises an urgent need to teach 
decision making, that effort may be useless unless adolescents have already acquired the necessary 
basic cognitive skills. Beyth-Marom et al. (1987) provkto such task analysis for decision-making under 
certainty. Matched with an analysis of cognitive development (Keating, 1980; 1988; Kuhn, Amsel, & 
O'Loughlin, 1988), it couM provkle the basis for timing and sequencing the learning of these skills. 

How much teaching is needed? 

If decision making requires many higher-order thinking skills, much time is dearty needed. The 
only sustained improvement in general thinking ski!^ reported in the IKerature involved two years of 
graduate training (Lehman, Lempert & Nisbett, 1988). 

What are the opportunity costs? 

Students part*^* ating in a cunlcukjm are doing that rather than son^ething else. One must, 
therefore, ask what they are giving up. We suspect that decision making can be taught and that it is 
worth the investment of significant class time. However, a nrnich stronger evklentiary base is needed if 
tfiat claim is to be made on the basis * scientific results rather than scientists' impressions. 
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TABLE 2: Evaluation Studies 











CURRICULUM 






Feature 


GOFER 


Personal 
Decision 
Making 


Odyssey 


Life 
Skills 
Schinke 
et al. 


Life 
Skills 
Botvin 


Decisk>n 
Skills 

Curriculum 


Manioulation 












Structure 


high 


high 


high 


low 


high 


IntenDediate 


Duration 
(hours)* 


(16-20) 


(10) 


56(5) 


8(2) 


10-20(2) 


8(2) 


Groups^ 


M.NM 


M.NM 


M.NM 


M.NM 
M.OM 


M.NM 


M.NM 


Decisio . 
Measures 


King 














Flinders 
ADM 
question- 
naire 


Decision 

Making 

test 


Ability 
tests 


Perspective 
taking 

Means*end 
thinking 


Decision- 
making 
autonomy 


Decisk>n- 
making 
question- 
naire 




Virgil 
question- 
naire 




TAT 


Anticipating Confidence 

consequences in 

problem 
solving 






Decision 

knowledge 

questionnaire 












Time of 
Testing 


Immed. 


Immed. 


Immed. 


Immed. 


Immed. 


Immed. & 
10 months 
later 



■The number in brackets specifies the nu.nnber of hours devoted to decision making. 

^M=group receiving focal curriculum; NM= control group receiving no treatment. OM»group receiving 
another curriculum. 
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Appendix 



END 

S. Dopt. of Education 

Office of Education 

Research and 
Improvement (OERI) 



ERIC 



Date Filmed 
March 29, 1991 



